Nonparametric Estimation via Convex Programming
نویسندگان
چکیده
In the paper, we focus primarily on the problem of recovering a linear form g x of unknown “signal” x known to belong to a given convex compact set X ⊂ R from N independent realizations of a random variable ι taking values in a finite set, the distribution p of ι being affinely parameterized by x: p = Ax + b. With no additional assumptions on X and A, we develop minimax optimal, within an absolute constant factor, and computationally efficient estimation routine. We then apply this routine to recovering x itself in the Euclidean norm.
منابع مشابه
Linear and Second Order Cone Programming Approaches to Statistical Estimation Problems
Estimation problems in statistics can often be formulated as nonlinear optimization problems where the approximating function is also constrained to satisfy certain shape constraints. For example, it may be required that the approximating function be nonnegative, nondecreasing or nonincreasing in some variables, unimodal in a variable, convex, or concave. We show how these shape constraints can...
متن کاملEstimation of Nonparametric Conditional Moment Models with Possibly Nonsmooth Moments
This paper studies nonparametric estimation of conditional moment models in which the residual functions could be nonsmooth with respect to the unknown functions of endogenous variables. It is a problem of nonparametric nonlinear instrumental variables (IV) estimation, and a difficult nonlinear ill-posed inverse problem with an unknown operator. We first propose a penalized sieve minimum distan...
متن کاملShape Constrained Density Estimation via Penalized Rényi Divergence
Abstract. Shape constraints play an increasingly prominent role in nonparametric function estimation. While considerable recent attention has been focused on log concavity as a regularizing device in nonparametric density estimation, weaker forms of concavity constraints encompassing larger classes of densities have received less attention but offer some additional flexibility. Heavier tail beh...
متن کاملConstrained Nonparametric Estin1ation via rvIixtures
\Ve a approach to measures constrained to lie in a convex set. \Ve measures as mixtures known extreme measures, and so the of eS1Jlnlal;lng a constrained measure becomes one of estimating an unconstrained mlXmeasure. constraints arise in many such as estimation of the mean estimation under stochastic constraints. Vve describe mixture representation techniques for these and other and to maximum ...
متن کاملNonparametric bivariate copula estimation based on shape-restricted support vector regression
Copula has become a standard tool in describing dependent relations between random variables. This paper proposes a nonparametric bivariate copula estimation method based on shape-restricted -support vector regression ( -SVR). This method explicitly supplements the classical -SVR with constraints related to three shape restrictions: grounded, marginal and 2-increasing, which are the necessary a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007